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I. INTRODUCTION 

Optically trapped ultracold atoms possess various hy- 
perfine spin degrees of freedom. By trapping spinor 
atoms in optical lattices, one can explore the physics of 
hyperfine spin correlated ultracold atomic matter which 
generally has fantastically rich magnetic properties. It 
had been pointed out a while ago that cold atoms in opti- 
cal lattices can be used to simulate correlated physics re- 
lated to the Bose-Hubbard model [l[ and the superfiuid- 
Mott insulator transition; this transition, tuned by opti- 
cal lattice potential depth, has been observed in recent 
experiments For cold atoms with hyperfine spins, 
additional magnetic transitions in Mott states are possi- 
ble. For instance, spin-one atoms can have either ferro- 
magnetic interactions, such as for ^^Rb, or antiferromag- 
netic interactions, as for ^^Na 0, 0, 0- As shown before 
for sodium atoms, a first order phase transition between 
spin-ordered (nematic) and spin-disordered (spin-singlet) 
ground state occurs [g, 0, H, S [l^l in the Mott insulat- 
ing state. Magnetic fields or magnetization can further 
induce spontaneous nematic ordering [ll|, [l^l ■ 

Correlated spin-2 atoms have also been studied re- 
cently and were suggested to possess even richer phases. 
Apart from nematic and ferromagnetic phases, a cyclic 
phase is also proposed [3, 0, • Fascinating fraction- 
alized non-abelian vortex structures have been predicted 
[H, For nematic condensates, the accidental degen- 
eracy between nematic states with different symmetries 
(i.e. uni-axial versus bi-axial) has been shown to be lifted 
by zero point energies of spin-wave excitations which ef- 
fectively can be attributed to the mechanism of order- 
from-disorder [l^, [l^. In lattices, interactions between 
spin-two atoms further give rise to new kinds of spin- 
ordered to spin-disordered transitions [1^. A new class 
of quantum coherent dynamics induced by quantum fluc- 
tuations of spin waves and tuned by the optical lattice 
potential depth was also investigated recently [2l|. The 
distinct magnetic correlations in Mott insulating states 
were not taken into account in early studies of Mott- 
superfluid transitions of spin-2 atoms [13, . 

Experimentally, atoms on an _F = 2 manifold are usu- 
ally less stable than those on an F = 1 manifold when 



spin-one multiplets are lower in energy and spin-flip scat- 
tering processes lead to quick relaxation oi F = 2 atoms. 
This is particularly problematic for F ~ 2 multiplets of 
^^Na where spin-flip scattering is quite strong. But for 
^^Rb, spin-flip scattering is relatively weak. This iso- 
tope is therefore a more likely candidate for observance 
of the physics of correlated spin-two atoms. Early mea- 
suremen ts |24| and theoretical calculations of scattering 
lengths [23 suggest that spin-2 ^''Rb atoms have a ne- 
matic ground state. Coherent spin dynamics in conden- 
sates of spin-one or spin-two cold atoms as well as few- 
body controlled collisions have already been studied in 
experiments [2^ [13, [H, [1^, although direct evidence 
of spin correlated ultra cold matter in optical lattices is 
still absent. Investigation of cold atoms with high spins 
in optical lattices will lead to better understanding of 
fundamental principles of quantum magnetism; in addi- 
tion, it might also lead to potential applications towards 
quantum information storing and processing (sol . [3l| . 

In this article, we present detailed analysis of quantum 
states of spin-2 atoms in optical lattices. This subject 
was also addressed in a previous work where the authors 
minimized the mean-field energies of maximally ordered 
states with respect to a tensor order parameter [20[ ; those 
trial wavefunctions approximate the ground states quite 
well in the limit of large exchange coupling but deviations 
from those states can be substantial in the intermediate 
coupling regime. To address all possible ordered phases, 
in this article we extend our analysis to all possible mean- 
field states and carry out a systematic calculation to fur- 
ther determine the phase boundaries and the order of 
the phase transitions. We also discuss quadratic Zeeman 
effects. 

The organization of this paper is as follows. In Section 

II we define the system and operator-algebra. In Section 

III we consider the limit of zero hopping and derive exact 
phase diagrams for arbitrary numbers of atoms per lattice 
site. In Section IV we describe the self-consistent mean- 
field technique to deal with nonzero exchange coupling. 
In Section V we do calculations for nonzero exchange 
between the sites using this mean-field method for two, 
three and four particles per site. We conclude our studies 
in Section VI. 
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II. DESCRIPTION OF THE SYSTEM 

111 this section we introduce the theoretical framework 
to deal with cold gases of = 2 atoms. We describe the 
algebra of the number and spin operators and derive the 
Hamiltonian. 



A. Algebra 

As a starting point we take the usual creation and an- 
nihilation operators for F = 2, m = —2, . . . , 2 particles: 



(1) 



To work conveniently with the hopping term in the 
Hamiltonian we now introduce another basis. Using the 
spherical harmonics Y2m{0i4')^ the following operators 
are constructed: 



(2) 



i^yy = ""^(^"'-^ + - -^^Ao, (3) 



i^yz = --^{i'-l +l/'l), 



(4) 
(5) 
(6) 
(7) 



and the creation operators in the same way. These oper- 
ators have the following properties [20 |: 
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bl'af3,'4'a'l3>] = Saa' S /Sp' + Sa0' Si3a' - -SapSa' 0' (8) 
Tr[V3] = ^V^aa =0. (9) 



The density operator in terms of the new operators can 
be derived as: 

P = E^™^™ = ^Tr[^ty}] = 1 ^^t^^^^. (12) 

The factor ^ appears here because the trace involves a 

double sum over the operator ipap- This same factor 
will appear later when deriving the hopping term in the 
Hamiltonian. 

The spin operator is straightforwardly derived as: 



Fa = -iCap^i^ji^lpn-f 

It has the following properties: 

[K,p] = 

[Fa,m^^r]] = 0. 



(13) 

(14) 
(15) 
(16) 



The total spin operator is then given by: 

F'' = FaFa (17) 

= V'^^V'^^^r,7V'«/3 - + 6/5. (19) 

We also introduce the dimer creation operator as: 
1 



which has the following properties: 



(20) 



(21) 



This operator creates two particles which together form 
a spin singlet. In the same way we can construct an op- 
erator which creates three particles which together form 
a singlet. This is called the trimer operator and defined 



This last property puts a constraint on the constructions 
of linear operators. For operators 



Tr[A'0] = E Aq^V)/3c, 



(10) 



the tensor A can be always reduced to a traceless one, 



Tr[A] = E Aca = 0. 



(11) 



This constraint is needed, because when introducing this 
new basis we have enlarged the Hilbert space by con- 
structing six operators out of five. This constraint brings 
the size of the physical Hilbert space back to the original 
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Tr[(V;t)3 



(22) 



Finally we introduce the nematic operator as: 

1 ^ ^ ^ ^ 2 

Qap = ipi,j4',jp - -SafiTT[ij^2/j] = - -^Sapp. (23) 

The non-vanishing eigenvalues of this operator indicate 
the presence of nematic order [l3| . 



B. Hamiltonian 

We consider F = 2 atoms in an optical lattice. The 
laser wavelength is A. This results in a potential V{r) = 
Vb(sin2(27rx/A) + sm^{2TTy/\) + sin^ {2tt z / X)) . We as- 
sume that the optical lattice potential is deep enough 
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such that the lowest band approximation and the tight 
binding approximation are apphcable. The Hamiltonian 
is then given as (20l |: 



n 



2 ^ 



» (ij) 



(24) 



where i is the site index, (ij) means that the sum is over 
neighboring sites, t is the hopping parameter and the 
constants a^, and cl can be expressed, in terms of 
atomic mass M , on-site ground state wavefunction V-'o(x) 
and scattering lengths a^? in the total hyperfine spin F = 
0, 2, 4 channels, as: 



OL = 



4TTff{4:a2 + 804) 

7M 
47r?i^(a4 — 02) 
7M 

^^^^{lao - 10a2 + 804) 
35M 



rf'x|Vo(x)| 



(25) 
(26) 

d3x|^(x)|4. (27) 



The hopping amplitude t is given by the overlap integral 



t 



1 



2m 



y(x) 



,^(x+^e,), (28) 



where arc the unit-vectors in x, y and z direction. 
Note the additional factor i appearing here. This factor 
needs to be inserted, because the trace in the hopping 
term in Eq. (|24p involves a double sum over the indices 

of the creation and annihilation operators '0^^ . 



C. Mott Hamiltonian for p > 1 

We now assume that the system is in a Mott state with 
p particles per site. When the number of particles on a 
lattice site is larger than one (i.e. p > 1), we assume that 
the spin splitting in the virtual hopping process can be 
ignored. This is justified because ^ ^l, cl, such that 
the density-density interaction dominates. This leads to 
an effective Mott Hamiltonian 



HMott = y5](i^2-6/50 + 5cL5]25|A (29) 

i i 
(ij) 

where Jox ~t^/aL is the exchange coupling. 

In analogy with the spin F = 1 case, we now introduce 
the 'traceless' operator 



it 



1 - - / 2 



(30) 



Using the definition of p, we can rewrite: 



(31) 



1 



This operator is 'traceless' because 

Qi;al3,0,a = 0. 

a, 13 



(32) 



It has the property that is symmetric under interchange 
of a and p and a' and and that 



Qi:aP,a'l3' — Q\a' P' ,al3 



(33) 



In terms of this operator the exchange term (due to vir- 
tual hopping processes) in the Hamiltonian can be rewrit- 
ten as (up to terms which contain the local density and 
in the Mott state therefore only give rise to an energy 
shift): 

Hex = --^oxXl ('3L/3,a'/3'Qj>/3,a'/3' +h.C.y (34) 



D. Magnetic Fields: Quadratic Zeeman Effect 

The presence of a magnetic field leads to linear and 
quadratic Zeeman effects. The linear Zeeman effect leads 
to an additional term in the Hamiltonian 



'^lin.Z — — giin ^ B • Fi 



(35) 



For concreteness we take the magnetic field in the z- 
direction: B = Be^ and Tiun.z = ^ 9iin-B ^j,z- How- 
ever, the total Hamiltonian commutes with Fi^^, so that 
once the system is prepared, the expectation value (fi,z) 
will remain the same. In experiments, atoms are usually 
initially prepared in the (2, 0)-state. This means that 
in the experimental situation the linear Zeeman effect 
is irrelevant. Relevant is the quadratic Zeeman effect. 
It is important to note that the quadratic Zeeman ef- 
fect gives an energy shift to the individual particles, de- 
pending on their spin-state. Writing fii^ra = Vim''i'i,rm 
m = — 2, . . . , 2, the Hamiltonian describing the quadratic 
Zeeman effect is therefore given by: 



Hquad.Z = gquad ^ (^i4 + + 4(nj_2 + "4,-2)) 



Observing now that 



(36) 
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Qi,zz = ~3("-'M + "-i -1) ~ 3 ("'«^2 + ni,^2) + (37) 

we see that we can write: 



(38) 



4 



where we leave out the term involving pi because it only 
gives a constant contribution. 

Like in the case of spin-1 bosons [l^l we see that this 
term does not commute with F'^. Therefore the spin- 
singlet states are unstable with respect to this pertur- 
bation and ncmatic order is induced for infinitesimally 
small coupling. 



III. ON-SITE SPECTRUM 

When the tunneling is zero, the sites are decoupled. In 
this case the full spectrum can be derived for arbitrary 
(integer) numbers of particles per site [U, l20|. The local 
operators p, Fa, T) and T)^ obey the following commuta- 
tion relations 



= 1 







22? 

2 ^ 



The spin-operators commute with all other local opera- 
tors and form a SU(2)-algebra. The density and dimer 
operators together form a SU{1, l)-algebra [iJI- This can 
be seen by defining 



2?- 



P 
2 



5 
4' 



Those operators obey the algebra: 



(39) 

(40) 
(41) 



(42) 
(43) 



In analogy with the spin-algebra we now define the 
Casimir operator as 



1 



2 V 



(44) 
(45) 



This operator commutes with and and there- 
fore also with 2?''', 2? and p. Now we consider a state 

IV'min) with Pmin atOmS (1.6. p|V'min) = Pmin l^/'min) and 
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(p. 2p) 






6 k+2 or p = 6 k+4 (d) p = 6 k+5 or p = 6 k+7 



FIG. 1: (Color online) Phase diagrams in the case of iso- 
lated lattice sites for various particles numbers p. The differ- 
ent phases are indicated by the quantum numbers d and F: 
{d, F). The angles 9a, ■ ■ ■ ,0^ between the phases depend on 
the particle number and are defined in the text. 



form a singlet pair. That means that the above intro- 
duced state IV'min) contains no singlet pairs and pmin 



unpaired atoms. 



Applying D to this 



with Xt 



state 

l + 2pn: 



we get 
Ap- 



plying now t)'^ to l-i/jmin) adds singlet pairs but keeps 
the number of unpaired atoms constant. Since com- 
mutes with V'^ , all the states (^^^ IV^min) with number 
of atoms p = Pmin + 2np (i.e. Pmin unpaired atoms and 
Up pairs) have the same quantum number Xjj = 
of the Casimir operator. 

So we find a relation between the particle number and 
the quantum number of the Casimir operator as p = 
+ 2np which means that for p atoms, the possible 
eigenvalues arc Xd — — np, Up being the number of 
pairs. We therefore replace the quantum number Xd by 
the number of unpaired atoms d = Pmin = ^^"2^^ ■ 

We can then express the on-site energy in terms of the 
four quantum numbers p, d and F . After some straight- 
forward algebra this yields: 



E{p,d,F) 



a-L 



p{p-l) + 4{F{F + l)~6p) 



+ ^((2p + 3)2-(2d + 3)2). (46) 



-Dm 



0. The operator V destroys two atoms that 



In order to find the ground state, we have to take care of 
the bosonic symmetry. The requirement that the bosonic 
wave function is symmetric implies that some combina- 
tions of quantum numbers are forbidden. In general for a 
number of atoms p we have p = d+2np and F = 0, . . . , 2d, 
because the paired atoms don't contribute to the spin. 
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However, if d = 3fc the values F = 1,2, 5, 2d — 1 are 
forbidden because of symmetry and if d = 3fc± 1 the val- 
ues F — 0, 1, 3, 2d — 1 are forbidden. By minimizing the 
energy under those conditions the ground states can be 
identified. We label each state by two quantum numbers 
as (d, F) . This yields the phase diagrams as shown in 

Fig.m 

The phases are separated by critical angles tan 9 ~ 
which are given by: 

tan 6*0, 

tan 6fj 

tan 9^ 



fJ ] o 

4p + 2 






(47) 


7 

"3 






(48) 


p + 4 
4p + 6 






(49) 


4fc + - if p = 
3 


= 6fc + 


2 


(50) 


8fc + ^ if p 

O 


= 6fc 


f 4 


(51) 


11 -c 

AkA if p 

3 


= 6fc 


f 5 


(52) 


S/c + ^ if p 


= 6fc 


f 7 


(53) 



tan 9 s 



tan( 



tan 9^ 

The states appearing in this limit are 

• Ferromagnetic: d = p, F ~ 2d ~ 2p 

• Trimer: d = p = 3k, F = 

• Cyclic: d = /9 = 3fc±l,F = 2 

• Dimer: d ^ 0, F ^ 

• Nematic: d = 1, F = 2. 

It is worth remarking that strictly speaking for individual 
lattice site, there is no long range order and symmetry- 
breaking states do not exist in this limit. However, in- 
finitesimal hopping could couple the directors of the bro- 
ken symmetries in some cases and establish long range or- 
der; the notations of nematic and cyclic introduced above 
refer to states which will have the respective long range 
order if infinitesimal hopping is allowed and are only truly 
meaningful when nonzero hopping is taken into account. 

In the numerical scheme pursued in the next sections, 
we distinguish the phases by the following order param- 
eters: 

• Ferromagnetic: (V^V) = 0, (F^) = 2p(2p+ 1). 

• Trimer: (F^) = 0, (V^V) = 0, (Qap) = 0. 

. Cyclic: (Ptp) = 0, < (F^) < 2p{2p+l), (Q^p) = 
0. 

. Dimer: {F^) - 0, (ptp) = Si^, (Q„^) = 0. 

• Nematic: (F^) = 0, {Qap) + 0, (Ptp) > 0. 



IV. NONZERO TUNNELING 

We now turn to the case of nonzero tunneling between 
neighboring lattice sites. In this case there is a com- 
petition between states with broken symmetries or long 
range order and states without broken symmetries. To 
deal with this situation we make the Ansatz that the to- 
tal many-body wave function is a product wave function 
over the lattice sites: 



n 



We moreover assume that the spatial symmetry is unbro- 
ken, such that the wavefunctions are identical on each 
lattice site. We thereby exclude antiferromagnetically 
ordered states, but they turn out to have higher energy 
than the states with unstaggered long range order. In the 
numerical scheme they would moreover be identified by 
oscillating solutions. Following this procedure the Hamil- 
tonian in Eq. (j29[) turns into a local Hamiltonian, which 
is coupled in mean-field to the neighboring lattice sites: 



i i 
— >/cxE] \ QXal3,a' l3'Qr,<^P,<^' P' ~^ Q i:al3,a' I3'Q i\al3 .a' 



(54) 



where Qj-a0,a'i3' = {Qj-ap,a'i3')- The term 
JcxQ*.ai3,a'0'Qj;aP,a't3' IS a constaut term in the 
Hamiltonian. However, this term is important for 
comparing energies of the different states, to be able to 
identify the ground state solution in the case of multiple 
stable solutions. 

Since this is now only a local problem we drop the site 
index and get (also dropping the constant terms): 



Tilocal = y(F2-6p) + 5CL:D+:D 



-z,L 



Here we have introduced the lattice coordination number 
z, which is equal to z = 6 for the three-dimensional cubic 
lattice. 

To take into account the full on-site Hilbert space, we 
use another basis. Namely, we define five symmetric, 
traceless tensors A^, which are orthonormal in the sense 
that 



Tr[A* A,.] = S^J2. 



(56) 
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An explicit example of these are given by: 



Ai = 




M = 77 











c 
O 


1 









4 





-1 














J 




rt - 


1 


\ 




X 



-3 


2 





) 


(58) 


N 


1 


^ 





















(59) 




-1 

-2 * 



This choice is arbitrary, but has the advantage that we 
can work with purely real matrices. In terms of the orig- 
inal spin-operators we have: 



Tr[Ai7/'] 


-■00 




Tr[A27/'] 






Tr[A37/.] 






Tr[A4?/'] 






Tr[A5i^] 







The on-site trial wave function is 



}jL---<7 

\^l■■■a)= n Tr[A„V'^]|0), 



(60) 



where C^...a is the amplitude at a particular state 
\^ . . .a). After tracing over the traceless tensors A^, we 
express the expectation value of the Hamiltonian in Eq. 
([55)1 in terms of these amplitudes. By minimizing the en- 
ergy with respect to C^...a, we obtain the ground states 
in different parameter regions and the mean-field phase 
diagrams. 



V. PHASE DIAGRAMS FOR NONZERO 
TUNNELING 

In this section we present the results of numerical cal- 
culations following the scheme introduced in the previous 
section. We present result for two, three and four parti- 
cles per lattice site. 



A. p — 2: Two particles per site 

For two particles per site we obtain the phase diagram 
in Fig. O As pointed out before [2^, in this case, dimer. 




-4 -2 2 4 



FIG. 2: (Color online) Phase diagram for two particles at 
a site: phase boundaries between the dimer (D), nematic 
(A"!, 2), cyclic (C) and ferromagnetic {F) phases 



nematic, cyclic and ferromagnetic phases appear. More- 
over, we also observe an additional nematic phase be- 
tween the dimer and cyclic phase; in Fig. [5] this phase 
is indicated as ^^2- This state differs from the A^i state 
by its decomposition in terms of eigenstates of the to- 
tal spin. The A^i state has a nonzero projection in the 
F = 0, F ^ 2 and F = 4 state, but the A^2 state consists 
only of states with F ~ and F = 2. The F = 4 compo- 
nents are absent because of the large value of 6l at the 
position where this phase appears. We call the A^i state 
a Maximally Ordered nematic State and the A^2 state a 
Minimally Ordered nematic State, because the A''2 state 
only involves the minimally needed states to break the 
translational symmetry. 

Quantifying the phase diagram we see that for 6^ and 
cl positive, but when bL/cL < | the system remains 
in the cyclic phase. Upon increasing bL/cL there is the 
possibility of a phase transition from the cyclic phase to 
the nematic phase as Jex is varied and ultimately there 
is also a transition from the nematic phase to the dimer 
phase when Jox is decreased. For small Jox the phase 
boundary between the cylic and dimer phase approaches 
bh/cL = 5/3, in agreement with the analysis in Sec. III. 
We also find this agreement for the phase boundary be- 
tween the ferromagnetic and dimer phase: it indeed ap- 
proaches ^l/cl = 1/2 for small Jex- 

In Figs. [3] order parameters are plotted for two ratio's 
of cl/6l. In particular we choose cl = as realized 
for 87Rb [H and cl/6l = 0.25, as reahzed for ^SNa. 
As is visible there, the A2 nematic phase experiences a 
second order transition to the dimer phase. By contrast, 
the transition between the A^i nematic phase and the 
dimer phase as shown in Fig. [3] is of first order. Also the 
transition between the A'^2 nematic phase and the cyclic 
phase is of first order. 

We now investigate the stability of the dimer phase in 
the presence of a quadratic Zeeman field. The result is 
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CL/bL = 0.25 
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FIG. 3: (Color online) Order parameters for 2 particles per 
site and two ratio's of Ci/fe_L. At the top row we plot the 
expectation value of the dimer counting operator &'£> and the 
total spin operator F^, which is rescaled with a factor 1/20 for 
visual clarity. The second row displays the eigenvalues of the 
nematic order parameter Qai3- Two eigenvalues {Qxx,Qyy) 
are always identical. The third row shows the eigenvalues 
of the operator FaFp — ^SapF^ . Again, two eigenvalues are 
identical. At the bottom row we plot the projection of the 
wave function onto the states with total spin F — 0, 2, 4. 
The total spin states F = 1,3 are not allowed because of the 
bosonic symmetry. For CL/bL = (left column) we observe 
the transition from the dimer phase into the nematic (first 
then A*'i) phase. For c_l/6l ~ 0.25 (right column) the 
system has an additional transition to the cyclic phase. 



presented in Fig. [H As anticipated, the dimer phase is 
unstable towards a quadratic Zeeman field and nematic 
order is induced for infinitesimal couplings. 



B. p = 3: Three particles per site 

For three particles per site we obtain the phase di- 
agram in Fig. [5] As predicted before [l^l the phase 
diagram contains the nematic, cyclic, ferromagnetic and 
trimer phase. Calculating the phase border numerically, 
we see that the nematic phase extends into the positive cl 
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FIG. 4: (Color online) Eigenvalues of the nematic tensor in 
the presence of a quadratic Zeeman field for two particles 
per site in the dimer phase (cl/6l ~ 0, zJcx/fez, ~ 0.2) as 
a function of gquad/fcz,. For nonzero gquad the system always 
displays nematic order. 



quarter. In the asymptotic limit of small Jox we recover 
the results from Sec. Ill that the critical slope separating 
the trimer and nematic phase is given by ^l/cl = —7/3 
and between the nematic and ferromagnetic phase by 
bL/cL = 7/18. 

Again we present the order parameters for two ratio's 
of CL/bL in Fig. [S) From this we read off that the cyclic- 
trimer and nematic-trimer transition are both of first or- 
der nature. 

We also investigate the stability of the trimer phases 
against a quadratic Zeeman field. As shown in Fig. [3 
the trimer phase is unstable against such a field, even for 
small values. 
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FIG. 5: (Color online) Phase diagram for three particles at a 
site: phase boundaries between the trimer (T), nematic (N), 
cyclic (C) and ferromagnetic (F) phases 
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FIG. 6: (Color online) Order parameters for 3 particles per 
site and two ratio's of cl /bL- From top to bottom we plot ex- 
pectation values ofthe dimer counting operator V^V and the 
total spin operator F^, (top row); eigenvalues of the nematic 
order parameter Qa/s (second row); eigenvalues of the oper- 
ator FcFp — ^SapF^ (third row); and the projection of the 
wave function onto the states with total spin F = 0,2, 3, 4, 6 
(bottom row). The total spin states F = 1, 5 are not allowed 
because of the bosonic symmetry. For Ci/bi = (left col- 
umn) we observe the transition from the trimer phase into 
the nematic phase. For clI^l ~ 0.25 (right column) the sys- 
tem undergoes the trimer-cyclic transition. 



C. p — 4: Four particles per site 

For four particles per site we get the phase diagram in 
Fig. [51 Like in the case of two particles per site we obtain 
the ferromagnetic, cyclic, dimer and nematic phase. 

Also in this case, the nematic phase is split into two 
sub-phases. The N2 phase has only a projection into the 
F = and F = 2 states, but the TVi state has a projection 
into all the allowed total spin eigenstates. In analogy to 
the case for p = 2, we call the A'^i a Maximally Ordered 
nematic State and the N2 a Minimally Ordered nematic 
State. However, in contrast with the case of two parti- 
cles per site, the nematic phase {N2) only spreads over 
a finite area of the parameter space. For large foi/zJox 
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FIG. 7: (Color online) Eigenvalues of the nematic tensor in 
the presence of a quadratic Zeeman field for three particles 
per site in the trimer phase (cl/&l ~ 0, zJc^/bL = 0.2) as 
a function of qquad/bL- For nonzero gquad there is always 
nematic order. 



there is a direct transition between the dimer phase and 
the cyclic phase. For small Jox the slope of the phase 
border between the dimer and cyclic phase is given by 
^l/cl = 14/3, in agreement with the analysis in Sec. III. 
Likewise the phase border between the ferromagnetic and 
dimer phase is given by Bl/cl = 7/18 for small Jex. We 
present the order parameters for various ratio's of CL/bL 
in Fig. [51 It is clear that this gives a first order transition 
between the A'^i phase and the dimer phase. However, in 
this case also the transition between the N2 phase and 
the dimer phase appears to be of first order. 

The stability of the dimer phase in a Quadratic Zeeman 
field is presented in Fig. [TOl The dimer phase is unstable 
against a quadratic Zeeman field for infinitesimal fields. 
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FIG. 8: (Color online) Phase diagram for four particles at 
a site: phase boundaries between the dimer (D), nematic 
(Ai'1,2), cyclic (C) and ferromagnetic (F) phases 
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FIG. 9: (Color online) Order parameters for four particles 
per site and two ratio's of cl/&l- From top to bottom we 
plot expectation values of the dimer counting operator V'^'D 
and the total spin operator F"^ (top row); eigenvalues of the 
nematic order parameter Qq/s (second row); eigenvalues of 
the operator FaFp — ^SapF"^ (third row); and the projection 
of the wave function onto the states with total spin F — 
0,2,4,6,8 (bottom row). The total spin states F = 1,3,7 
are not allowed because of the bosonic symmetry. Although 
= 5 is allowed, the states do not have a projection into this 
total spin state. For cl/&l = (left column) we observe the 
transition from the dimer phase into the nematic (first N2, 
then A''i) phase. For CL/bL ~ 0.25 (right column) the system 
is always in the cyclic phase. 



D. The case for the F = 2 state of *^Rb 

We now turn to the experimentally most relevant case 
of *^Rb. For this case the parameters are such that cr 
within experimental accuracy, whereas 0^/6^ « 95 f 
It is a particularly important question whether the dimer- 
nematic and trimer-nematic transitions happen within 
the Mott regime, i.e. whether on increasing the tunneling 
amplitude t the transition from the dimer/trimer state 
occurs before the Mott insulating state is destroyed and 
the system becomes a superfluid with nematic order. 

In order to answer this question we calculate the 
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FIG. 10: (Color online) Eigenvalues of the nematic tensor in 
the presence of a quadratic Zeeman field for four particles 
per site in the dimer phase (cl/6l ~ 0, zJcx/fei ~ 0.1) as 
a function of qquad/bL- For nonzero qquad there is always 
nematic order. 



critical ratio -^p- for which the spin-ordered to spin- 
disordered transition happens. We then estimate the 
corresponding value of Oi/t and compare it with the crit- 
ical ratio jt at which the Mott insulator to superfluid 
transition occurs. We assume a three-dimensional cubic 
lattice and hence take 2 = 6. 

For two particles per site the Mott insulator to super- 
fluid transition for spinless bosons occurs for aj^jt « 100 
(note that t as defined in this paper is half as large as 
normally used for spinless bosons) [1^. This has to be 
compared to the value oi aL/t at the dimer- nematic tran- 
sition, which happens when -^j^ w 2 for p = 2. Taking 

into account Jrx = — , we conclude that the dimer ne- 

ah ' 

matic transition happens at a^/t w 34 i.e. at a higher 
value of the hopping amplitude t than the Mott-insulator 
superfluid transition. This means that for two particles 
per site the dimer-nematic transition in the Mott phase 
is preempted by the transition to the superfluid. 

For three particles per site the Mott insulator to super- 
fluid transition for spinless bosons occurs for a^/f sa 140 
[33 |. This has to be compared to the trimer-nematic 
transition, which happens for -^j^ w 2.7 for p = 3. This 
corresponds to ^ w 39. So the trimer-nematic transition 
won't take place before Mott states enter the superfluid 
phase 

The superfluid-insulator transition for /o = 4 happens 
at ^ ~ 180 [13]. As seen from Fig. [6] the dimer-nematic 



transition occurs for jy- « 5, which corresponds to 
^ w 53. This means that also for four particles per site 
the dimer-nematic transition is preempted by the Mott- 
insulator superfluid transition. 

However, since the spin-ordering affects the phase 
boundary to the superfluid phase p^ . |23| . the precise 
nature of these transtitions remains unclear and further 
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investigation is needed. 

VI. CONCLUSIONS 

In this article we studied magnetic transitions in the 
Mott states of spin-2 atoms for various particle num- 
bers per site. We derived the exact phase diagram for 
zero tunneling. For the case of nonzero tunneling we 
used a self-consistent mean-field technique to study the 
phase diagram. We found various symmetry breaking 
transitions, depending on the microscopic parameters. 
In particular, for the microscopic parameters of ^^Rb 
there is the possibility of a dimer-nematic transition and 
also a transition within the nematic phase, which cor- 
responds to a transition between a maximally ordered 



nematic state and a minimally ordered nematic state. 
However, the nematic-dimer transition happens already 
for smaller a^/zJcx ratio than the usual Mott transition 
does. Therefore the precise nature of this transition re- 
mains to be clarified in future work. 

A magnetic field induces a quadratic Zeeman coupling, 
which within the states with unbroken symmetry gives 
rise to nematic order even for infinitesimal coupling. 
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